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TELEVISION/INTERNET TERMINAL USER INTERFACE 



RELATED APPLICATION DATA 
This application is a continuation-in-part of applications Ser. No. 09/099,118, 
5 filed June 17, 1998, entitled "Communicating Logical Addresses of Resources in a 
Data Service Channel of a Video Signal," and Ser. No. 09/099,481, filed June 17, 
1998, entitled "Combining Real-Time and Batch Mode Logical Address Links," the 
disclosures of which are incorporated by reference. 

10 FIELD OF THE INVENTION 

The present invention relates generally to user interfaces for interactive 
television which facilitate switching between viewing a television program and 

r h 

3 viewing content related to that television program. 

HI 

W 15 BACKGROUND OF THE INVENTION 

%t The Internet is a well-known, global network of cooperatively interconnected 

computer networks. The World Wide Web ("WWW" or "Web") portion of the Internet 
% is a collection of interconnected server computers hosting World Wide Web sites 

H= (referred to as "Web sites") on the Internet. A Web site consists of stored electronic 

on 

20 documents ("Web pages" or "Web content") written in a hypertext mark-up language 
("HTML") format and containing references to numerous dependent documents. 
Web pages can be accessed by a computer user having a connection to the 
Internet. There are millions of Web sites on the Internet, providing an enormous 
spectrum of content, including content relating to popular television shows, specific 
25 episodes, and popular television characters, and other content desirably associated 
with a television program by advertisers, producers, or broadcasters (together, 
"related content" or "auxiliary data"). 

A Uniform Resource Locator ("URL") identifies the location of a document on 
the Internet. For example, URLs beginning with the prefix " http://www " identify Web 
30 sites and content within the Web sites. Internet content, especially Web content, is 
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frequently identified by URL during television programs or commercial 
advertisements. 

Typically, individuals access the Internet from personal computers by way of 
software such as an Internet browser, which can be integrated with the operating 
5 system of a computer, or packaged as a separate application program. An Internet 
browser provides a graphical user interface to the Internet by interpreting and 
displaying Internet content, and supporting user navigation of the Internet. 

With the advent of Internet terminals, such as those pioneered by WebTV 
Networks, Inc., persons without access to a personal computer are also able to 
10 access the Internet. Internet terminals work in conjunction with a standard television 
("TV") set to display Internet content. Using a user input device such as a remote 
control or keyboard, a user can navigate the Internet through an Internet terminal. 
Existing WebTV Internet terminals allow a user alternately to watch TV or browse 
P the Internet. A user cannot simultaneously watch TV and browse the Internet. 

15 Further, no graphical user interface facilitates a user switching between watching TV 
and browsing the Internet for related content. 

Alternative mechanisms for packaging related Internet content with a 
television program have been offered. These mechanisms include encoding related 
content into a broadcast television signal, for example the Intercast Industry Group's 
20 Intercast technology, and encoding a URL into a broadcast television signal, with 
Internet content subsequently downloaded from the Internet using the URL, for 
example systems provided by WebTV and ACTV. 

The Intercast user interface allows a user to view simultaneously a television 
program and Internet content. The television program is displayed in a reduced 
25 format window. Related content is displayed in a separate window and browsed off- 
line through a navigation mechanism in a third window. The windows for displaying 
and navigating Internet content fill a significant portion of the available screen 
space. In allowing simultaneous viewing of television and Internet content, the 
Intercast user interface significantly reduces the television viewing space. Further, a 
30 viewer of television may find the display of related content in a separate window to 
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be obtrusive or distracting. The Intercast user interface does not unobtrusively 
notify a viewer that related Internet content is available for viewing. Moreover, 
although a viewer desirably is allowed to switch easily between full screen viewing 
of television and related content, the Intercast user interface does not unobtrusively 
5 provide a graphical control panel to enable such seamless switching. In addition, 
the Intercast user interface does not facilitate a user desirably selecting between 
displaying related content of interest or displaying no related content at all. 

The ACTV user interface synchronously displays a television program and 
timestamped related content. The television program is displayed in a reduced 

10 format window on the display screen, with the related content displayed adjacently. 
Alternatively, the television program and related content are displayed on separate 
display screens. In addition, the ACTV user interface includes on a portion of the 
display screen a control panel with a list of URLs that have been broadcast and 
received by the ACTV system. The control panel may also display URLs for which 

15 content is not synchronously displayed but is nonetheless relevant. 

In the ACTV user interface, the control panel and window for displaying 
Internet content fill a significant portion of the available screen space. Although an 
alternative design with separate display screens is offered, many viewers do not 
have two display screens. In addition to significantly reducing the television viewing 

20 space for most viewers, the ACTV user interface does not unobtrusively notify a 
television viewer that related content is available for viewing, or provide an 
unobtrusive graphical user interface to facilitate seamless switching between full 
screen viewing of television and related content. Moreover, because the ACTV user 
interface synchronously displays Internet content, the ACTV user interface does not 

25 facilitate a user desirably selecting between displaying related content of interest or 
displaying no related content at all. 

SUMMARY OF THE INVENTION 
In accordance with embodiments of the present invention, the above- 
30 described and other drawbacks of the prior art are overcome. 
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A preferred embodiment of the present invention includes a graphical user 
interface for interactive television viewing of a television program and related 
content. The graphical user interface enables access to related content without 
displaying the television program in a reduced format window. The graphical user 
5 interface accomplishes this by unobtrusively notifying a television viewer that related 
content is available for viewing, and upon viewer demand providing an unobtrusive 
control panel that facilitates switching between television and related content. In 
this way, a user knowledgeably and desirably distinguishes between related content 
to be displayed and related content not to be displayed. 
10 In an illustrated embodiment of the present invention, a graphical user 

interface facilitates a user switching between viewing a television program and 
viewing related Internet content. While watching a television program, an icon 
appears on the screen of a display device indicating that a logical address link is 
available to related content. In one embodiment of the present invention, for 



m 



rt _ 15 example, a WebTV user interface displays a translucent T icon in the upper right 
SJ hand corner of the television screen if a URL for a Web page relating to the viewed 

television program has been received. 
" If the user actuates a certain button on a user interface selection device, a 

^ panel appears on the screen displaying graphical control objects and a description 

yg 20 of the related content. If the user actuates one type of graphical control object, the 
panel disappears. If the user actuates another type of graphical control object, the 
logical address link is followed to retrieve the related content, and the related 
content is displayed. While the related content is being retrieved, the television 
signal may be displayed in a reduced format and a progress indicator displayed until 
25 the related content is displayed. 

For example, if the user actuates the "Go" button on a WebTV remote control 
while the icon is displayed, a translucent panel is displayed. The translucent panel 
includes a descriptor for the Web page and two control buttons, one for ending the 
panel display and the other for linking to the Web page. If the linking button is 
30 actuated using standard WebTV user interface and control techniques, the Web 
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page and its dependencies are downloaded, a graphical progress indicator appears 
on the screen and the television signal is displayed in reduced form. After the Web 
page is downloaded, it is displayed. 

In an alternative embodiment of the present invention, the icon signaling the 
5 availability of a logical address link is displayed for a fixed period of time on the 
display screen before disappearing. The graphical user interface may also display 
an icon only if it has been determined that the icon has not previously been 
displayed for a particular logical address link to related content. In this way, the icon 
is not redisplayed for the same logical address link. In addition to signaling the 

10 viewer about content available over the Internet, the icon may signal the availability 
of content stored on a CD-ROM or other accessible mass storage device, or on an 
intranet server or other network. 

The panel can include additional graphical control objects. For example, the 
panel may include a graphical control object for saving the described logical address 

1 5 link to related content into an archival folder. The archival folder can then be 
browsed at a later time, and a logical address link within the folder followed. A 
graphical control object for displaying a list of recently provided logical address links 
and allowing the user to select and follow a displayed logical address link can 
likewise be provided. The panel may include a graphical control object for 

20 displaying a list of previously retrieved content and browsing the content. 

Although retrieved related content is displayed instead of the television 
program in one embodiment of the present invention, in another embodiment, the 
television program continues to be displayed along with the retrieved related 
content. 

25 Additional features and advantages of the invention will be made apparent 

from the following detailed description of an illustrated embodiment, which proceeds 
with reference to the accompanying, drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 is a diagram illustrating several client systems connected to a server 
system. 

Figure 2 is a diagram illustrating a client system in which an illustrative 
5 embodiment of the present invention is employed. 

Figure 3 is a block diagram illustrating exemplary functional units of a set-top 
box according to one embodiment of the present invention. 

Figure 4 is a flow diagram illustrating a method of transporting logical address 
links according to one embodiment of the present invention. 
10 Figure 5 is a diagram illustrating a television program displayed on a screen 

of a display device, according to one embodiment of the present invention. 

Figure 6 is a flow diagram illustrating link reception processing according to 
y3 one embodiment of the present invention. 

m s Figure 7 is a diagram illustrating an icon displayed in addition to the television 

ii 15 program, signaling to a viewer the availability of a logical address link to related 
content, according to one embodiment of the present invention. 

Figure 8 is a flow diagram illustrating user input processing according to one 
embodiment of the present invention. 

Figure 9 is a diagram illustrating a panel displayed in addition to the television 
20 program, in response to viewer indication of interest in the related content, 
according to one embodiment of the present invention. 

Figure 10 is a diagram illustrating a television program displayed in a reduced 
format along with a progress indicator, in response to viewer indication of desire to 
retrieve the related content, according to one embodiment of the present invention. 



25 



DETAILED DESCRIPTION OF AN ILLUSTRATED EMBODIMENT 
For expository convenience, the present invention is described with reference 
to an illustrative embodiment, namely a WebTV Internet terminal. It will be 
recognized, however, that the invention is not so limited. 



30 
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System Overview 

Figure 1 illustrates a basic configuration of an Internet system network in 
which one embodiment of the present invention can be implemented. A number of 
clients 1 are coupled to a modem pool 2 via direct-dial, bi-directional data 
5 connections 29. These connections can be telephone (POTS, i.e., "plain old 

telephone service"), ISDN (Integrated Services Digital Network), cable, satellite, etc. 

The modem pool 2 is coupled through a router, such as that conventionally 
known in the art, to a number of remote servers 4 via a conventional network 
infrastructure 3, such as the Internet. The Internet system includes a server 5, 
10 which specifically supports the clients 1. The clients 1 each have a connection to 
the server 5 through the modem pool 2 and the Internet 3. 

□ 

p Embedding of Logical Address Links 

jm Various embodiments of the present invention will be described with 

^ 15 reference to logical addresses that are embedded within a broadcast television 

V J signal. The logical addresses may provide "links" to Internet, Web, or other local or 

s remote content related or unrelated to a program being broadcast. A form of logical 

address (also referred to as a resource locator) commonly associated with Web 
*t content is a Uniform Resource Locator ("URL"). A URL is a compact string 

3 20 representation of a location used to identify an abstract or physical resource on the 
Internet. Of course, alternative means of uniquely identifying content may be 
employed. For example, it is appreciated that keys (e.g., database indices), network 
addresses (e.g., IP addresses), and other identification mechanisms, alone or in 
combination, may be employed to uniquely identify a resource. Therefore, while the 
25 term URL refers to a specific type of content identifier used in connection with the 
Web, the terms logical address and/or resource locator are used herein to refer to 
content/resource identification mechanisms generally. 

Links to Internet/Web content provide an easy and powerful way to bring the 
richness and interactive nature of the Internet to TV. Such links may be used by 
30 program producers, program sponsors, networks, local affiliates, and other content 
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providers to link TV viewers to web content specifically designed to complement 
what the viewers are watching on TV. Various embodiments of the present 
invention provide and transmit logical addresses that identify content (e.g., Internet 
content) within a video signal. For example, content providers can transmit URLs to 
5 viewers by inserting URL data, in a predetermined syntax, within line 21 of the 
vertical blanking interval of an analog television signal. Other known data 
embedding techniques can also be used. 

According to one aspect of the present invention, on receipt of a logical 
address in a TV signal, an icon or some other visual indication is presented to the 
10 viewer to notify the viewer of the availability of Internet content. The viewer can 
then select the visual indication to view the content concurrently with the TV 
broadcast or save the logical address for later viewing. 
p Logical addresses embedded in video may refer to content stored on a CD- 

m ROM or other mass storage device, an Intranet server, or other resource. 

15 Additionally, certain aspects of the invention described herein are equally applicable 
to other TV viewing devices, such as personal computers equipped with TV tuners, 
and the like. Moreover, while various embodiments of the present invention will be 
described with reference to an NTSC broadcast video signal, other broadcast TV 
systems are equivalent for the purpose of the present invention, such as Phase 
20 Alternate Lines (PAL), Sequential Couleur Avec Memoire (SECAM), and the 

proposed High Definition Television (HDTV) standard. Finally, it is appreciated that 
a variety of other transport mechanisms can be employed, including digital satellite, 
digital TV, and cable TV. 



Q 
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25 An Exemplary Client System 

Figure 2 illustrates an Internet system client ("client") 1 known in the art. The 
client 1 includes an electronics unit 10 (hereinafter referred to as "the set-top box 
10"), an ordinary television set 12, and a user interface selection device 11. (In an 
alternative embodiment of the present invention, the set-top box 10 is built into the 

30 television set 12 as an integral unit.) In the embodiment depicted, the client 1 uses 
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the television set 12 as a display device for displaying video data and a graphical 
user interface. The set-top box 10 is coupled to the television set 12 by a video link 
6. The video link 6 is an RF (radio frequency), S-video, composite video, or other 
known form of video link. 
5 The set-top box 10 includes hardware and/or software for receiving and 

decoding a broadcast video signal 8, and providing video data to the television set 
via video link 6. The set-top box 10 also includes hardware and/or software for 
providing the user with a graphical user interface, by which the user can access 
various Internet services, browse the Web, send e-mail, and otherwise access the 
10 Internet. 

User interface selection device 1 1 allows the user to control the client 1 in 
browsing the Web, sending e-mail, and performing other Internet-related functions. 
In an illustrated embodiment, user interface selection device 1 1 is a hand-held 
remote control. In alternative embodiments, a wireless keyboard, keyboard, or other 

1 5 input device is operated by the user in order to control the client 1 . The set-top box 
10 receives commands from user interface selection device 1 1 via an infrared (IR) 
communication link. (In alternative embodiments, the link between the user 
interface selection device 1 1 and the set-top box 10 may be RF or other known 
mode of transmission.) 

20 Figure 3 is a block diagram further detailing the set-top box 10. As shown, 

set-top box 10 includes a CPU 21, ROM memory 22, RAM memory 23, an infrared 
interface 24, a television interface 31, an audio DAC 25, a video encoder 26, a 
telephone modem 27, an ISDN modem 30, mass storage 28, and an ASIC 20. 

ASIC 20 serves as a bus coupling the other illustrated components, under the 

25 control of CPU 21 . In some embodiments, ASIC 20 also includes dedicated video 
processing circuitry that shrinks the size of the displayed television broadcast so as 
permit display of user interface elements, as more particularly detailed below. 
(Techniques for shrinking the size of a displayed television signal are known in the 
art, so are not belabored here.) 
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The infrared interface 24 receives signals from the remote control 1 1 and 
provides corresponding data to the set-top box. The television interface 31 receives 
broadcast video signals, such as an NTSC video signal, and extracts embedded 
data. The extracted data, or a portion thereof, can be displayed concurrently with a 
5 television program For example, in one embodiment of the present invention, titles 
corresponding to logical addresses that have been inserted into a text mode data 
service or a captioning data channel of line 21 of the VBI are extracted by the TV 
interface 31 and displayed on the TV 12. An exemplary syntax for transporting 
logical addresses in line 21 of the VBI is described below. 

10 Read-Only Memory 22 provides storage of program code for implementing 

application software to be executed by the set-top box 10. Memory 22 may be a 
programmable ROM (PROM) or any form of erasable PROM (EPROM) or Flash 
memory. Mass storage device 28 is optional, and can be used to input software or 
data to the client, or to download software or data received over network connection 

15 29 or data embedded in broadcast signal 8. The mass storage device 28 can 
include any suitable medium for storing machine-executable instructions, such as 
magnetic disks, optical disks, and the like. 

Syntax and Usage of Logical Address Links 
20 Having described an exemplary environment in which embedded logical 

addresses may be employed, logical address links, their syntax, and usage will now 
be discussed. Generally, logical address links, such as TV Crossover Links™, 
enable seamless integration of television programming and the Internet by allowing 
Internet content to be associated with a television broadcast. (TV Crossover Links™ 
25 is a trademark of WebTV Networks, Inc. of Palo Alto, California.) 

In one embodiment, client 1 allows Web content and television programming 
to be concurrently displayed as described in co-pending patent application number 
09/087,354, entitled "Method and Apparatus for Displaying Hypertext Mark-up 
Language and Video Simultaneously" filed May 29, 1998, assigned to the assignee 
30 of the present invention and incorporated herein by reference. 
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Associations between a television broadcast and Internet content can be 
performed in real-time or in batch mode. Real-time logical address links are sent to 
the TV viewer's client system during a television broadcast, e.g. in line 21 of the VBI. 
In contrast, batch mode logical address links are delivered to the client system in 
5 advance of the television broadcast to which they relate. For example, batch mode 
logical address links can be downloaded from a Web server to the user's client 
system or delivered on CD-ROM or other computer readable medium. Batch mode 
logical address links can also be delivered as part of an electronic programming 
guide (EPG) and may be modified and/or supplemented with real-time logical 
10 address links. 

While real-time logical address links are valid for a predetermined amount of 
time after receipt by the client system, batch mode logical address links typically 
define a time interval. For example, a batch mode logical address link may include 
a start time and an end time indicating when the link is to be made available to the 
15 viewer. 

J Logical addresses can be transmitted in one of the text service channels of 

line 21, i.e., First Text Service (T1), Second Text Service (T2), Third Text Service 
i (T3), or Fourth Text Service (T4), or one of the captioning data channels of line 21 , 

I i.e., Primary Synchronous Caption Service (CC1), Special Non-synchronous Use 

j 20 Captions (CC2), Secondary Synchronous Caption Service (CC3), or Special Non- 
synchronous Use Captions (CC4), by using the following encoding format for logical 
address strings on line 21 of the VBI: 

<bgical address> [attributei ivaluei] [attribute2:value2] ... [attributen:valuen] [checksum] 



25 The logical address (e.g., a URL) is enclosed in angle brackets. One or more pairs 
of attributes and values may follow the logical address in square brackets. Finally, a 

checksum follows the n^ attribute/value pair in square brackets. It is appreciated 
that delimiter characters other than angle brackets and square brackets may be 
employed. However, it is important to avoid employing delimiters that are included 
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in the URL character set. Additionally, it is preferable that the delimiter be present in 
both the standard EIA-608 character set and the US-ASCII character set to make 
logical address links relevant to the widest set of devices. 

Exemplary attributes include type and name . The type attribute indicates to 
what the content relates. For example, the content may be related to the current 
television program, to the broadcast network, or to one of the commercial sponsors 
of the current TV program. Table 1 lists exemplary values that may be associated 
with the type attribute. 



m 
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Type Attribute Value 


Related to 


PROGRAM 


the current program 


NETWORK 


the broadcast network 


STATION 


the local station 


SPONSOR 


a commercial sponsor of the current 
program 


OPERATOR 


the service (e.g., cable or satellite) 
operator 



Table 1: Meaning of Type Attribute Values 



The name attribute provides a concise title for the resource identified by the 
logical address. It is preferable to associate a title with a logical address since the 
1 5 logical address itself doesn't always make clear what the content of the identified 
resource is. For example, the URL 

http://www.nbc.com/tvcentral/shows/seinfeld/characters/index.html might identify a 
web page on NBC's web site that describes frequently appearing characters on the 
Seinfeld television program. Therefore, for the viewers' convenience, a value such 
20 as "Seinfeld Stars" may be associated with the name attribute for this logical 

address link. Similarly, a web page relating to guest stars, such as the web page 
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located at http://www.nbcxom/tvcentral/shows/seinfeld/characters/cha might 
be associated with the name "Seinfeld Guest Stars." 

Other attributes can be employed as well. For example, a mechanism for 
purging old links may utilize an attribute that identifies a date or a date/time at which 
5 a logical address link expires. In this manner, after the date indicated, logical 
address links having an expired attribute may be purged from the client's memory. 

Importantly, attributes are optional and need not appear in any particular 
order. For purposes of illustration, exemplary logical address links are listed below 
(note, however, the checksums have not been calculated): 
1 0 <http:/AA/ww.nlxx<^^ [name.Seinfeld Stars] 

[A6F1] 

<http://www.tvprogram.com> [type:program] [name:TV Program] [C8C5] 
<http://advsponsor.net> [type:sponsor] [name:Special Offer] [BFAO] 
<http://madkad_network.com> [type: network] [1128] 
1 5 <http://www.coolsite.com> [6C1 D] 

It should be appreciated that logical addresses are not limited to URLs, and 
that URLs are not limited to the "http:" scheme. Therefore, the following would also 
be recognized as valid logical address links: 
20 <mailto:info@advsponsor.net>[type:sponsor][5FDB] 

<news:alt.tv.program][type:program][391B] 



A checksum is appended to the end of the logical address link in order to 
detect data corruption that may occur during receipt or transmission of the logical 

25 address link. Preferably, a two byte hexadecimal checksum is employed, such as 
that produced by the standard TCP/IP checksum algorithm described in Request 
For Comments (RFC) 719, "Internet Protocol", September 1981. The checksum can 
be computed by pairing adjacent characters in the string (starting with the first 
delimiter) to form 16-bit integers. If there are an odd number of characters, the final 

30 character is paired with a byte of zeroes. The checksum is computed such that the 
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one's complement sum of all of the 16-bit integers plus the checksum equals the 16- 
bit integer with all 1 bits. That is, the checksum is the one's complement of the 
one's complement sum of the 16-bit integers. In this manner, fewer errors go 
undetected than in previously suggested 7-bit checksum schemes, with only a 
5 negligible increase in the logical address link's overall length. 

Various embodiments of the present invention employ transportation and 
reception of logical address links. Fig. 4 is a flow diagram illustrating an exemplary 
method of transporting logical address links. In the illustrated method, logical 
address link data to be inserted by a content provider (e.g., a program producer, 
10 broadcaster, affiliate, cable or satellite provider), is inserted into upstream video (the 
source of video onto which the new data will be encoded). At step 410, upstream 
video data is received from a previous point in the video signal distribution path. At 
q step 420, a determination is made as to whether or not the current distribution point 
^ has one or more logical address links that are to be associated with the current TV 
«J 15 program being transmitted. If not, processing continues with step 450. Otherwise, 
*y processing proceeds with step 430. 

"™ The upstream video may or may not contain previously encoded data, such 

5 as logical address links, in line 21 of the VBI. Each content provider, therefore, is a 

6 potential re-encoding point along the distribution path. At step 430, the existing data 
55 20 is extracted from the captioning data channel or the text service channel of the video 

signal. Subject to certain bandwidth limitations, the content provider then embeds 
one or more logical address links into a captioning or text service packet of the video 
signal (step 440). Finally, at step 450, the video signal is transmitted to the next 
downstream receiving device(s). This process may be repeated during video signal 
25 processing at each point along the video signal distribution path. 



WebTV Television Crossover Link™ User Interface 
Referring to Figure 5, a television program 500 is displayed on the television 
set 12, as discussed above in conjunction with Fig. 2 and 3. 
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Logical address link receiving devices, such as a set-top box 10, are able to 
receive and process logical address links embedded in a broadcast video signal. 
Figure 6 is a flow diagram illustrating logical address link reception processing 
according to one embodiment of the present invention. At step 610, a broadcast 
5 video signal, such as an NTSC video signal, is received. Video data extracted from 
the broadcast video signal is passed through to the display device, e.g., a TV 12 or 
other display device, such as a computer monitor, for presentation to the viewer. 

Encoded data within a captioning or text service channel of the video signal is 
extracted at step 620. The system determines whether or not a valid logical address 
10 link is present (step 630). A valid logical address link is one that is encoded in a 
predetermined syntax, such as described earlier, and whose logical address and 
attribute/value pairs are not corrupted (as determined by a comparison of a 
checksum generated by the receiving device to the checksum accompanying the 
logical address link). If a valid logical address link is present, then processing 
15 continues with step 640. At step 640, as described below, the viewer is alerted that 
a logical address link is associated with the TV program currently being viewed. 
According to various embodiments of the present invention, this alert may be a 
visual indication, an audible signal, or a combination thereof. For example, an icon 
lZ ma y temporarily be displayed in one of the corners of the display area. Additionally, 

y3 20 a tone may accompany the icon's initial presentation. Other alert mechanisms are 
possible. In any event, continued reception and processing of the broadcast video 
signal and embedded logical address links may be achieved by returning to step 
610. Returning to step 630, if no valid logical address link is present in the video 
signal, then processing loops back to step 610 
25 Referring to Figures 6 and 7, at step 640, an icon 700 is displayed on the 

television set 12, signaling to the viewer of the television program 500 that a logical 
address link related to the television program 500 is present. The icon 700 may be 
translucent (e.g. the video luminance, only, is adjusted to form the icon per known 
techniques) so as to minimize distraction from the television program 500. Although 
30 in Figure 7 the icon 700 is superimposed on the upper right hand corner of the 
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television program 500, both the appearance and the placement of the icon 700 can 
be altered without departing from the principles and scope of the present invention. 

The display of icon 700 for a particular logical address link ends when the 
viewer indicates interest in the related content associated with icon 700. Moreover, 
5 to prevent an unwanted icon from persisting on the display screen, and to alert the 
viewer when a new or different logical address link has been received, the display of 
icon 700 may end after a fixed period of time. In one embodiment, display of the 
icon 700 lasts at most 15 seconds. In an alternative embodiment, when identical 
logical address links are repeatedly received by the receiving device 10, the icon 
10 700 is displayed only if it has been determined that the icon 700 was not previously 
displayed for a particular logical address link. In this way, the icon 700 is not 
redisplayed for the same logical address link. (The link data may be sent repeatedly 
during a program to account, e.g., for viewers tuning in after the beginning of the 
program. Viewers who have been watching since the beginning should not be 



In Figure 7, the icon 700 signals the viewer that a logical address link to 
related HTML content on the Web is available. An icon might alternatively signal the 
availability of content stored on a CD-ROM or other accessible mass storage device, 
or on an intranet server or other network. 



responds to the alert. At step 810, a viewer indication of interest in the related 
content is received. Typically, a viewer indicates such interest by actuating a control 
on a user interface selection device 1 1 . For example, on a WebTV remote control, a 
viewer presses the "Go" button to indicate interest. As is known in the art, a variety 
25 of other mechanisms for indicating interest are available for other user interface 
selection devices. 

In response to the viewer indication of interest 810, a translucent panel 900 
(Fig. 9) is displayed 820 over the television program 500. The panel 900 includes a 
descriptor 910 of the related content (e.g. "Seinfeld's Stars," or "Seinfeld Guest 
30 Stars," as referenced above), and one or more graphical control objects 920. The 



B 15 



alerted each time the link data is re-sent.) 



a 20 



Fig. 8 is a flow diagram showing how the system responds when the viewer 
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descriptor 910 can be transmitted along with the logical address link (e.g. as a name 
attribute of a transmitted URL), or can be obtained from another source. (The 
appearance of panel 900, it position, and contents, can be varied without departing 
from the scope of the present invention. For example, descriptor 910 can include, 
5 or consist entirely or, the raw URL, rather than an associated textual description.) 

Panel 900 gives the viewer additional information beyond the mere fact of an 
alert (provided by the icon 700). If, after receiving this additional information, the 
user wishes to pursue the associated content, the remote control device 1 1 can be 
operated to select and invoke (using known user interface selection/invocation 
10 techniques) the "Go to Web Page" graphical control object 920 on the panel 900. If 
this action is taken, the Fig. 8 flow chart proceeds from step 830 to 840, and transfer 
of the related content is initiated (e.g. downloading the web page from the Internet is 
j3 commenced). 

jl In the illustrated embodiment, if the "Go to Web Page" option is selected, the 

W 15 system removes the panel 900 from the screen, shrinks the displayed television 

m 

SS image, and introduces a bar-graph status indicator at the bottom margin of the 

screen to show process in downloading the associated content. This indicator can 

y include a descriptor of the logical address link or related content being retrieved. (In 

jM* other embodiments, the status indicator can be displayed in translucent form over 

*g 20 the full-screen television image, or can be omitted entirely.) 

" y When the associated content is fully downloaded and buffered in RAM 

memory 23, the television image is replaced by display of the associated (e.g. web) 
content. (In other embodiments, the associated content does not supplant the 
television image on the screen, but is displayed, picture-in-a-picture format, within 
25 the television image. In still other embodiments, it is the television program that is 
displayed in a window within a display of the associated content.) 

If, after reviewing the additional link information provided by panel 900, the 
viewer decides not to further pursue the associated content, the "Watch TV" 
graphical control object 920 can be selected and invoked, thereby returning the 
30 screen to the television-only display of Fig. 5. 



\ 
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Control panel 900 can include additional graphical control objects 920 
beyond those shown. For example, a graphical control object can be provided for 
selectably saving the received logical address link into an archival folder. The 
archival folder can be browsed by the viewer at a later time, and desired logical 
5 address links within the archival folder can be followed. (In the WebTV user 
interface, selection of such a graphical control object saves the then-alerted URL 
into a "Favorites" folder.) 

In addition to selectably adding links to a "Favorites" folder, certain 
embodiments of the present invention automatically log all logical address links 
10 received by the system into a master list. A graphical control object 920 can be 
operated to display this list, and the viewer can select and follow a link for display. 
(In the WebTV user interface, a graphical control button 920 labeled "Recent" 
permits the viewer to peruse and follow URLs logged in the master list.) By this 
arrangement, a viewer who does not wish to interrupt present viewing of the 



W 15 television program, but desires later to pursue a link, can do so. 
St The system can similarly list (and cache, if desired) previously-retrieved 

" content, permitting the viewer to browse and quickly retrieve content presented 
"5 earlier for display. Again, a graphical control object 920 on control panel 900 can 

H call-up such a list. 



operations for the related content addressed by the received logical address link are 
initiated 840, and the display of panel 900 ends 860. While the steps of Figure 8 
illustrate one embodiment of the method of the present invention, the ordering of 
several steps in Figure 8 can be changed without departing from the principles and 
25 scope of the present invention. 

To provide a comprehensive disclosure without unduly lengthening this 
specification, applicants incorporate by reference the following patents and patent 
applications: 



£ 20 



Returning to Fig. 8, after a linking control object is actuated 830, retrieval 



U.S. Patent 



5,778,181 to Hidary et al., entitled "Enhanced Video 



30 



Programming System and Method; 
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U.S. Patent 5,745,909 to Perlman et al, entitled "Method and Apparatus for 
Reducing Flicker When Displaying HTML Images on a Television Monitor;" 

U.S. Patent Application 08/755,238, filed November 22, 1996 (and now 
published as WO 98/23059); 
5 U.S. Patent Application 08/755,233, filed November 22, 1996 (and now 

published as EP 844,788); 

U.S. Patent Application 08/754,164, filed November 22, 1996 (and now 
published as EP 844,768); 

U.S. Patent Application 08/755,237, filed November 22, 1996 (and now 
10 published as EP 844,572); 

U.S. Patent Application 08/677,914, filed July 9, 1996 (and now published as 
WO 98/04088); 

35 U.S. Patent Application 08/677,915, filed July 9, 1996 (and now published as 

[J WO 98/01825); 

W 15 U.S. Patent Application 08/660,087, filed June 3, 1996 (and now published as 

HI WO EP 812,096); and 

^ U.S. Patent Application 08/660,088, filed June 3, 1996 (and now published as 

5 EP 81 1,940). 

M Having described and illustrated the principles of our invention with reference 

lift 

^3 20 to a preferred embodiment, in will be recognized that embodiments can be varied in 
m arrangement and detail without departing from such principles. 

For example, while the preferred embodiment employs a software- 
programmed general purpose CPU, in conjunction with an ASIC that performs video 
processing (e.g. shrinking) functions, in other embodiments such systems can be 
25 realized entirely by dedicated hardware. 

Similarly, while the invention has been described with reference to an Internet 

terminal system, such as the WebTV® Internet terminal, it is equally applicable in 
other contexts, e.g. in accessing other stored information in other viewing systems. 



WYC/SAW/KBR: ejk 9/15/98 338 5 MS 124197.1- 20 - EXPRESS MAIL L^^. NO. EM295377798US 

Date of Deposit: 9/15/98 

While the foregoing disclosure has focused on systems in which the link data 
is displayed when it is received, in other embodiments this need not be the case. 
For example, link information can be stored in the set-top box, and the viewer can 
be alerted thereto (e.g. by icon 700) when certain conditions exist. For example, a 
link to an NBC program guide can be alerted to the user at the top- and bottom- of 
every hour, whenever the viewer is tuned to the local NBC affiliate. (Such link data 
can be transmitted to the set-top box in background fashion, using otherwise-idle 
bandwidth in the VBI or other auxiliary video channel.) 

Although the foregoing embodiments employ the same icon 700 for all alerts, 
in other embodiments different icons can be used. For example, different icons can 
be used to distinguish between advertising-related and programming-related 
content. The alert can also include data about the link, such as the name of the link. 
While such an arrangement is more obtrusive, some viewers may prefer the 
provision of added detail without having to invoke the control panel 900. 

In view of the wide variety of possible embodiments to which the principles of 
our invention can be applied, it should be recognized that the detailed embodiments 
are illustrative only and should not be taken as limiting the scope of our invention. 
Rather, we claim as our invention all such variations as come within the scope and 
spirit of the following claims, and equivalents thereto. 



